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CLAIMS 

We claim: 

1. A system for instruction memory storage and processing in a computing device 
having a processor, the system being based on backwards branch control information, the 

5 system comprising: 

a dynamic loop buffer (DLB) organized as a direct-mapped structure, said DLB 
being a tagless array of data; 

a DLB controller having a primary memory unit partitioned into a plurality of 
banks, wherein said controller controls the state of the instruction memory storage 
10 system, accepts a program counter address (pc address) as an input, and outputs distinct 
signals; 

an address register located in the memory of said computing device, wherein said 
address register is a staging register for said program counter address, and an instruction 
fetch process takes two cycles of said processor; and 

15 a bank select unit for serving as a pc-address decoder to accept the program 

counter address and to output a bank enable signal for selecting a bank in a primary 
memory xmit, and a decoded address for access within the selected bank. 

2. The system of claim 1, further comprising: 

a first multiplexor for selecting amongst a plurality of banks of said primary 
20 memory unit; 

a second multiplexor for selecting between the DLB and the primary memory unit 

output; 

a latch for staging the data; and 
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a data-out register located in the main memory of said computing device, wherein 
said data-out register receives instruction data for said processor at the decode stage. 

3. The system of claim 1, wherein said primary memory unit is one of a static 
random access memory (SRAM) or a dynamic random access memory (DRAM). 

4. The system of claim 1, wherein said DLB is made of energy efficient growable 
register arrays (GRAs). 

5. The system of claim 1, wherein said DLB is made of energy efficient register 
array cells. 

6. The system of claim 2, wherein said distinct signals output from said DLB 
controller include: 

signals to enable/disable said processor to access said primary memory unit, to 
read the DLB and to write the DLB; 

decoded address signals for said processor to access said DLB; and 

select signals to select a first multiplexor. 

15 7. The system of claim 1, wherein said DLB further includes a read or write port 

and accepts three input signals. 

8. A method of instruction memory storage and processing in a computing device 
having a processor, a dynamic loop buffer (DLB), and a DLB controller, the method 
being based on backwards branch control information, the method comprising the steps 
20 of: 

measuring cycles from a valid program counter address latched from an address 
register to valid data; 

latching said program counter address said DLB controller and a bank select unit 
from said address register at a rising edge of every clock cycle; 
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said DLB controller and said bank select unit processing signals for data access 
during a first half of the clock cycle; 

latching signals at the DLB and at a primary memory unit on the falling edge of 
the clock cycle; and 

completing and output data in a data register in one clock cycle. 

9. A method of claim 8, further comprising a step of latching data from a data 
register to a data-out and to the DLB for storing at the falling edge of the clock, when 
said controller is in a FILL state. 

10. An instruction buffer managing system in a computing system including a 
processor, said system comprising: 

an instruction address input for receiving one or more program coimter values 
from said processor; 

a controllable path between the instruction address input and an instruction 
address output that passes program counter values to an instruction memory, the 
instruction memory being connected to the instruction address output, wherein said 
program counter values received at the instruction address input are monitored; 

a controller for defining a range of instructions, the range of instructions 
comprising ai loop; and 

a filler for filling a buffer with each instruction of a range in a first pass, except 
for at least one unfilled instruction, wherein the program counter values on one or more 
subsequent loop iterations are continuously monitored until an unfilled instruction is 
encountered and a buffer manager provides said unfilled instruction. 

1 1. A system of claim 10, wherein said unfilled instructions are within a sub range 
defined by a forward non-consecutive control flow instruction. 



17 



728-236 (YOR920030149) 

12. A system of claim 10, wherein said unfilled instructions are within a sub range 
defined by a backward non-consecutive control flow instruction. 

13. A system of claim 10, wherein an instruction address of said unfilled 
instructions fall outside a sequential address associated with the buffer and are therefore 

5 omitted. 

14. A system of claim 13, wherein the buffer manager takes unfilled instruction 
from the instruction memory. 

15. A system of claim 10, wherein instructions in the buffer are retained after the 
processor fetches instructions outside the range. 

16. A method of changing states of a dynamic loop buffer (DLB) controller 
having four states, to enable limiting a use of energy in a computing device having a 
processor, a DLB, and the DLB controller, while said computing device is performing 
instmction memory storage and processing using backwards branch control information, 
the method comprising the steps of: 

in an initial IDLE state, determining if a back branch was taken; 
entering a FILL state if the determination is positive, and 
if the determination is negative, determining if an unfilled entry was hit; 

entering the FILL state if the determination is positive, and 
if the determination is negative, determining if a filled entry was hit; and 

entering an ACTIVE state if the determination is positive, and 
if the determination is negative, retuming to the IDLE state. 

17. The method of claim 16, further comprising the steps of: 
25 in the FILL state, determining if an address is out of range; 

entering the IDLE state if the determination is positive, and if the 
determination is negative, determining if a filled entry was hit. 
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entering the ACTIVE state if the determination is positive, if the 
determination is negative, determining if an offset is greater than a physical 
address; and 

entering an OVERFLOW state if the determination is positive, 
if the determination is negative returning to the FILL state. 



1 8. The method of claim 17, further comprising the steps of: 
in the ACTIVE state determining if the address is out of range; 

entering the IDLE state if the determination is positive, and if the 
10 determination is negative, determining if an unfilled entry was hit; and 

entering the FILL state if the determination is positive, and if the 
determination is negative, determining if an offset is greater than a physical 
address; and 

entering the OVERFLOW state if the determination is positive, and 
15 if the determination is negative returning to the ACTIVE state. 



19. The method of claim 17, further comprising the steps of: 

in the OVERFLOW state, determining if an unfilled entry was hit; 

entering an FILL state if the determination is positive, and if the 
20 determination is negative, determining if a filled entry was hit; and 

entering the ACTIVE state if the determination is positive, and if the 
determination is negative, retimiing to the OVERFLOW state. 

20. A method of changing states of a dynamic loop buffer (DLB) controller 
25 having four states, to enable limiting a use of energy in a computing device having a 

processor, a DLB, and the DLB controller, while said computing device is performing 
instruction memory storage and processing using backwards branch control information, 
the method comprising the steps of: 
in a FILL state 
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fetching instruction packets from a primary memory unit, 
writing a copy of said instruction packets into a DLB, 
setting a valid bit to assert validity of said DLB, 

entering an ACTIVE state when a backward branch is taken within a range 
5 of a loop, 

entering an IDLE state when said backward branch completes a loop and a 
change of flow branch is taken out of range of said loop, and 

entering an OVERFLOW state if the DLB fills up and said change of flow 
branch is not taken; 

10 in the ACTIVE state 

presenting instruction fetches to the DLB, 

entering the IDLE state if said backward branch is not taken and a change 
of flow branch is taken out of range, 

entering the FILL state if the buffer is not full, if said backward branch is 
15 within the loop, 

entering an OVERFLOW state if the buffer is full, 
entering the FILL state if the buffer is fiill, and 

entering the OVERFLOW state if the end of the buffer is reached said and 
change of flow branch is not taken; 

20 in the OVERFLOW state 

reading instruction data packets fi^om a primary memory xmit of said 
computing device, 

entering the IDLE state after performing a jump or a branch instmction out 
of range of said loop; 
25 entering the ACTIVE state if said backward branch is taken, 

entering the ACTIVE state if a backward branch within the range of said 
loop is taken and data is valid, and 

entering the FILL state if a backward branch within the range of said loop 
is taken and data is invalid; and 

20 
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in the IDLE state 

accessing instruction data packets from the primary memory unit, 
entering the FILL state if a new backward branch is detected, and 

entering the ACTIVE state if a last loop captured in the dynamic loop buffer is 
5 repeated. 

21. A computer program device readable by a machine, tangibly embodying a 
program of instructions executable by the machine to perform method steps for a method 
of changing states of a dynamic loop buffer (DLB) controller having four states, to enable 
10 limiting a use of energy in a computing device having a processor, a DLB, and the DLB 
controller, while said computing device is performing instruction memory storage and 
processing using backwards branch control information, the method comprising the steps 
of: 

in a FILL state 

1 5 fetching instruction packets from a primary memory unit, 

writing a copy of said instruction packets into a DLB, 
setting a valid bit to assert validity of said DLB, 

entering an ACTIVE state when a backward branch is taken within a range 
of a loop, 

20 entering an IDLE state when said backward branch completes a loop and a 

change of flow branch is taken out of range of said loop, and 

entering an OVERFLOW state if the DLB fills up and said change of flow 
branch is not taken; 

in the ACTIVE state 
25 presenting instruction fetches to the DLB, 

entering the IDLE state if said backward branch is not taken and a change 
of flow branch is taken out of range, 
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entering the FILL state if the buffer is not full, if said backward branch is 
within the loop, 

entering an OVERFLOW state if the buffer is full, 
entering the FILL state if the buffer is fiiU, and 
5 entering the OVERFLOW state if the end of the buffer is reached said and 

change of flow branch is not taken; 

in the OVERFLOW state 

reading instruction data packets from a primary memory unit of said 
computing device, 

entering the IDLE state after performing a jump or a branch instruction out 
of range of said loop; 

entering the ACTIVE state if said backward branch is taken, 
entering the ACTIVE state if a backward branch within the range of said 
loop is taken and data is valid, and 

entering the FILL state if a backward branch within the range of said loop 
is taken and data is invalid; and 

in the IDLE state 

accessing instruction data packets from the primary memory unit, 
entering the FILL state if a new backward branch is detected, and 

entering the ACTIVE state if a last loop captured in the dynamic loop buffer is 
repeated. 
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